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Search of Subsequences with Maxim al Confidence 



The invention relates to a common component of: 

• Speech Recognition 

• Keyword Spotting 

• Segments Alignment for DNA and proteins (Human Genome) 

• Recognition of Objects in Images 

2 Background Art 

This invention addresses the problem of keyword spotting (KWS) in unconstrained speech 
without explicit modeling of non-keyword segments (typically done by using filler HMM 
models or an ergodic HMM composed of context dependent or independent phone models 
without lexical constraints). Although several algorithms (sometimes referred to as "sliding 
model methods") tackling this type of problem have already been proposed in the past, e.g., 
by using Dynamic Time Warping (DTW) [4] or Viterbi matching [9] allowing relaxation 
of the (begin and endpoint) constraints, these are known to require the use of an '"appro- 
priate" normalization of the matching scores since segments of different lengths have then 
to be compared. However, given this normalization and the relaxation of begin/endpoints, 
straightforward Dynamic Programming (DP) is no longer optimal (or, in other words, the 
DP optimality principle is no longer valid) and has to be adapted, involving more memory 
and CPU. Indeed, at any possible ending time e, the match score of the best warp and start 
time b of the reference has to be computed [4] (for all possible start times b associated with 
unpruned paths). Moreover, in [9], and in the same spirit than what is presented here, for 
all possible ending times e, the average observation likelihood along the most likely state 
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sequence is used as scoring criterion. Finally, this adapted DP quickly becomes even more 
complex (or intractable) for more advanced scoring criteria (such as the confidence measures 
mentioned below). 

More recently, work in the field of confidence level, and in the framework of hybrid 
HMM/ANN systems, it was shown [1] that the use of accumulated local posterior proba- 
bilities (as obtained at the output of a multilayer perceptron) normalized by the length of 
the word segment (or, better, involving a double normaUzation over the number of phones 
and the number of acoustic frames in each phone) was yielding good confidence measures 
and good scores for the re-estimation of A^-best hypotheses. Similar work, where this kind 
of confidence measure was compared to several alternative approaches, was reported in [8] 
and confirmed this conclusion. However, so far, the evaluation of such confidence measures 
involved the estimation and rescoring of N-best hypotheses. Similar work and conclusions 
(also using N-best rescoring) were also reported in using likelihood ratio rescoring and non- 
keyword rejection [7]. 

2,1 KWS without filler models 

Let X = {xx,X2,^ . . , Xn, . . . , xat} denote the sequence of acoustic vectors in which we want 
to detect a keyword, and let M be the HMM model of a keyword M and consisting of 
L states Q = {^u ^2, • ■ • , - • • . ^i^}- Assuming that M is matched to a subsequence = 
{xi,, . . . , Xe} (1 < 6 < e < A^) of X, and that we have an implicit (not modeled) garbage/filler 
state go preceding and following M, we define (approximate) the log posterior of a model 
M given a subsequence X^' as the average posterior probability along the optimal path, i.e.: 

-iogP(M|Xn _1_ min -logP(Qra 



e — b+1 VQeM 



mm {-\ogP{q''\qG) 



e-l 



■logP{q'\x,)-\ogP{qc\q')} (1) 



where Q = {q^, q^} represents one of the possible paths of length (e-fe+1) in M, and 

the HMM state visited at time n along Q, with q" G Q. In this expression, qo represents 
the "garbage" (filler) state which is simply used here as the non-emitting initial and final 
state of M. Transition probabilities P{q''\qG) and P(gGk^) can be interpreted as the keyword 
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entrance and exit penalties, as optimized in [3], but these have not been optimized here. In 
our case, local posteriors P{gi\Xn) were estimated output values of a multilayer perceptron 
(MLP) used in a hybrid HMM/ANN system [2]. 

For a specific sub-sequence A^, expression (1) can easily be estimated by dynamic pro- 
gramming since the sub-sequence and the associated normalizing factor (e- 6+ 1) are given. 
However, in the case of keyword spotting, this expression should be estimated for all possi- 
ble begin/endpoint pairs {b,e} (as well as for all possible word models), and we define the 
matching score of X on M as: 

SiM\X) = -\ogP{M\Xf) (2) 

where the optimal begin/endpoints {b\e*}, and the associated optimal path Q*, are the 
ones yielding the lowest average local posterior: 

(Q*, b\ e*) = argmin log PiQ\X^t) (3) 

{QAe} e- 0 + i 

Of course, in the case of several keywords, all possible models will have to be evaluated. 

As shown in [1, 8], a double averaging involving the number of frames per phone and the 
number of phones will usually yield slightly better performance: 

{QAe} J 3^1 - f>j + i n=6, / 

where J represents the number of phones in the hypothesized keyword model and q"} the 
hypothesized phone qj for input frame x^. 

However, given the time normalization and the relaxation of begin/endpoints, straight- 
forward DP is no longer optimal and has to be adapted, usually involving more memory and 
CPU. A new (and simple) solution to this problem is proposed in Section 3.1. 

2.2 Filler-based KWS 

Although various solutions have been proposed towards the direct optimization of (2) as, 
e.g., in [4, 9], most of the keyword spotting approaches today prefer to preserve the opti- 
maiity and simplicity of Viterbi DP by modeling the complete input [5] and explicitly [6] or 
implicitly [3] modeling non-keyword segments by using so called filler or garbage models as 
additional reference models. In this case, we assume that non-keyword segments are modeled 
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by extraneous garbage models/states qa (and grammatical constraints ruling the possible 
key word/non- keyword sequences). 

Let us consider only the case of detecting one keyword per utterance at a time. In this 
case, the keyword spotting problem amounts at matching the whole sequence X of length 
N onto an extended HMM model M consisting of the states {qg, 91, . . . , ^l, Qg], in which 

6-1 iV-e 

a path (of length A^) is denoted Q - {?^7^^, g^ ^^T^^} with {b - 1) garbage 

states qg preceding and {N-e) states qG following 9^, and respectively emitting the vector 
sequences Xf""^ and X^_^i associated with the non-keyword segments. 

Given some estimation of P{qG\xn) (e.g., using probability density functions trained on 
non keyword utterances), the optimal path Q* (andj consequently b* and e*) is then given 
by: 

Q* = argmin - log P{Q\X) 
= argmiii{-logP(QTO 

-Y,\ogP{qG\Xn)- E logPigalXn)} (5) 

n=l n=e-\-l 

which can be solved by straightforward DP (since all paths have the same length). The main 
problem of filler-based keyword spotting approaches is then to find ways to best estimate 
PiQcl^n) in order to minimize the error introduced by the approximations. In [3], this value 
was defined as the average of the N best local scores while, in other approaches, this value 
is generated from explicit filler HMMs. However, these approaches will usually not lead to 
the "optimal" solution given by (2), 

3 Disclosure of Invention 

3*1 Iterating Viterbi Decoding (IVD) 

In the following, we show that it is possible to define an iterative process, referred to as 
Iterating Viterbi Decoding (IVD) with good/fast convergence properties, estimating the value 
of Piqcl^n) such that straightforward DP (5) yields exactly the same segmentation (and 
recognition results) than (3). While the same result could be achieved through a modified 
DP in which all possible combinations (ail possible begin/endpoints) would be taken into 
account, it is possible to show that the algorithm proposed below is more eflficient (in terms 
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of both CPU and memory requirements). 

Here, I will use a similar scoring technique for keyword spotting without explicit filler 
model. Compared to previously devised "sliding model" methods (such as [4, 9]), the first 
algorithm proposed here is based on: 

1. A matching score defined as the average observation posterior along the most likely 
state sequence. It is indeed believed that local posteriors (or likelihood ratios, as in [7]) 
are more appropriate to the task. 

2. The iteration of a Viterbi decoding algorithm, which does not require scoring for all 
begin/endpoints or N-best rescoring, and which can be proved to (quickly) converge to 
the "optimal" (from the point of view of the chosen scoring functions) solution without 
requiring any specific filler models, using straightforward Viterbi alignments (similar 
to regular filler-based KWS, but at the cost of a few iterations) . 

3-2 IVD: Description 

The IVD algorithm is based on the same criterion than the filler based approaches (5), but 
rather than looking for expUcit (and empirical) estimates of P{qG\xn) we aim at mathemat- 
ically estimating its value (which will be different and adapted to each utterance) such that 
solving (5) is equivalent to solving (3). Thus, we perform an iterative estimation ofPiqclxn), 
such that the segmentation resulting of (5) is the same than what would be obtained from (3). 
Defining e =^ - logPigol^n)^ the proposed algorithm can be summarized as follows: 

1, Start from an initial value sq ^ e (it is actually proven that the iterative process 
presented here will always converge to the same solution (in more or less cycles, with 
the worst case upper bound of N iterations) independently of this initialization), (e.g., 
with s equal with a cheap estimation of the score of a "match'*). In the experiments 
reported below, s was initialized to - log of the maximum of the local probabilities 
P{qk\xn) for each frame 

An alternative choice could be to initialize £o to a pre-defined score that expression (1) 
should reach to declare a keyword "matching" (see point 4 below). In this last case, if 
e increases at the first iteration, then we can {as proven) directly infer that the match 
will be rejected, otherwise it will be accepted. 
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2. Given the current estimate St oiP{qa\xn) at iteration t, find the optimal path (Q^, 6t, ^t) 

according to (5) and matching the complete input. 

3. Update {t i-fl) the estimated value oisu defined as the average of the local posteriors 
along the optimal path Qt (matching the resulting of (5) on the keyword model) 
i.e.: 

4. Return to (2) and iterate until convergence. If we are not interested in the optimal 
segmentation, this process could also be stopped as soon as e reaches a (pre-defined) 
minimum threshold below which we can declare that a keyword has been detected. 

Correctness and convergence proof of this process and generalization to other criteria, are 
available: each IVD iteration (from the second iteration) will decrease the value of St, and 
the final path yields the same solution than (3). 

3.3 One-pass keyword spotting 
3.3.1 General Description 

The above algorithm has a very good experimental convergence speed (3-5 iterations in our 
tests). However, the worst case theoretical convergence speed of the process is N. For this 
reason, a one step computation is potentially interesting. In the next subsection we show 
that the standard DP cannot be used for solving the equation (3). 

3*3-2 The Principle of Optimality 

Let us define T{M,X) as the DP table of emission probabilities for an utterance X and 
the states of the hypothesized word W, When solving by standard DP, we would compute 
for each entry of the table T(M,X) at frame k oi X and state 5 of M three values: Sks, 
Lks and Cks, where Sts corresponds to the sum of the posteriors on the optimal path that 
leads to the entry, Lks holds the length of the optimal path computed so far, and C^s is the 
estimation of the cost on the optimal expanded path. 

By a path leading to an entry T{k, s) we mean a sequence of entries in the table T, such 
that there is exactly an entry for each time frame t<k. At each entry T{k, s), DP selects a 
locally optimal path noted P^s- 
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At each step k, we consider all pairs of entries of table T(M, X) of type T{k, s), T{k-1, t). 
We update for each such pair, the current cost Cks (initially oo), by comparing it with the 
alternative given by: 

Sks ^ S^k-i)t " logpis\xk)p{s\t) 
La,. -L(^_i)i + l,Vt >0,i<L 

Cks = ^ (7) 

wanting to have at step k the path P^s (^om the paths P(k-i)t that minimizes Cnl- With 
DP, one will choose the Pks with minimal C^s- 

In order for the previous computation to be correct, the optimality principle needs to 
be respected. The optimality principle of Dynamic Programming requires that the path to 
the frame k - 1 that minimizes Cnl, also minimizes Cks for an entry at frame k of table 
T(M, A"). We have proved that the expression 7 does not respect the optimality principle 
of Dynamic Programming 

3*3*3 Pruning with beam search 

The Dynamic Programming can be viewed as a set of safe prunings that are applied at each 
entry of the DP table and has the property that only one alternative is maintained. We have 
thus shown that Dynamic Programming cannot be used, since the principle of optimality is 
not respected. We try therefore to detect the type of safe pruning that can be done. 

We have proved that if at a frame a we have two paths and P^ with 5" < 5^ and 
L'^ < L'^, then at no frame c>a will a path P^' be forsaken for a path F^^ if P^CP^. P^CP," 
and P'\F=P''\P'\ We will note the order relation as P^^Pa- We have further shown that 
a path P' may be discarded only for a lower cost one, P". 

P^-^P" < CI (8) 

Thus, algorithm 1 computes S{M,X) and from equation (3). 

By ordering the set of paths, according to Equation 8, we only need to check the line 1.2 
of algorithm 1 up to the eventual insertion place. The last paths are candidates for pruning 
in line 1.1. In order for the pruning to be acceptable, we will prune only paths that were 
too long on the last state. An additional counter is needed for storing the state length. This 
counter is reset when the state is changed and is incremented at each advance with a frame. 
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1.1 



1.2 



procedure OneStep(^W^,Xj 
SetOfPaths(l..N, l..K)^0 
for all frame=l; frame <— N; framed— h do 
for all state=l; state <~ K; state-t^ do 

for all candidate PiGSetOfPaths(frame-l, L.K) do 

I Add{pi, SetOfPaths [frame, state]) 

end 
end 
end 

SetO£Paths[fraine, K] ^ best of the candidates 
end. 

procedure Add (path, set- of -paths) 

for bW piG set- of -paths do 

if path-<Pi then 

j delete Pt 
end 

if Pi-<path then 



I return 
end 
end 

Insert in set-of-paths 
end. 



Algorithm 1: One Step Algorithm 

3*4 One pass confidence-based keyword spotting 
3.4,1 The Method of Double Normalization 



The corresponding confidence measure is defined as: 



NVP 



, - log(jP.s^) 



(9) 



p^evp length{Pi) 

where NVP stands for the number of visited phonemes and VP stands for the set of visited 
phonemes. An average is computed over all posteriors pst of the emission probabilities for the 
time frames matched to the visited phoneme p^. The function length{pi) gives the number 
of time frames matched against pi . 

This method consists into a breath first Beam Search algorithm. It refers to a set of 
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reduction rules and certain normalizations: 

For the state qo, in this method, the logarithm of the emission posterior is equal with 
zero. For each frame e and for each state s, the set of paths/probabilities of having the frame 
e in the state s is computed as the first N maxima (N can be finite) of the confidence measure 
for all paths in HMM M of length e and ending in the state s. The paths that according 
to the reduction rules will loose the final race when compared with another already known 
path, will be deleted as well. 

We note ai, pi, 02, P2 and h the confidence measure for the previous phonemes, the 
posterior in the current phoneme and the length in the current phoneme for the path Qi, 
respectively the path Q2- The rules that may be used for the reduction of the search space 
by discarding a path Qi for a path Q2 are in this case any of the next ones: 

1. l2>lu A > 0, B < 0 and LlA + L^B + C > 0 

2. l2>lu A > 0, B > 0 and C > 0 

3. l2>lu A < 0, C > 0 and L^A + LB + C > 0 

4. l2>lu A = 0, 5 < 0 and + C > 0 

where ^4 = ai - a2, S = (ai - a2){li + ^2) +pi - P2-> 0^{ai - a2)/i/2 +Pi^2 - P2h, L = 
Lraax ' max{/i,/2}, = S I2A > 0 and Lmax is the maximum acceptable length for a 
phoneme. 

By discarding paths only if one of the above rules is satisfied, the optimum defined by 
the confidence measure with double normalization can be guaranteed, if no phone may be 
avoided by the HMM M. Any HMM may be decomposed in HMMs with this quality. The 
4-th rule is included in the 3-rd and its test is useless if the last one was already checked. 

First test, k > h tells us if Q2 has chances to eliminate Qi, otherwise we will check if 
Qi eliminates Q2- These tests were inferred from the conditions of maintaining the final 
maximal confidence measure while reduction takes place. In order to use the method of 
double normahzation without decomposing HMMs that skip some phonemes, the previous 
rules are modified taking into account the number of visited phonemes for any path Fi 
respectively F2 and the number of phonemes that may follow the current state. 

A simplified test may be: 

• l2>h, A>0,pi>p2 respectively F2>Fi for the HMMs that skips phonemes. 

9 
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This test is weaker than the 2"^^ reduction rule. For example a path is eliminated by 
a second path if the first one has an inferior confidence measure (higher in value) for the 
the previous phonemes, a shorter length and the minus of the logarithm of the cumulated 
posterior in the current phoneme also inferior (higher in value) to that of the second one. 

An additional confidence measure based on the maximal length, Lmax, and on the maxi- 
mum of the minus of the logarithm of the cumulated and normalized posterior in phoneme, 
Pmaxy can be used in order to hmit the number of stored paths. 

• P> LmaxPmax State 

• f > Pmax the output from a phoneme 

where p and 1 are the values in the current phoneme for the minus of the logarithm of 
cumulated posterior and for the length of the path that is discarded. These tests allow for 
the elimination of the paths that are too long without being outstanding, respectively of 
the paths with phonemes having unacceptable scores, otherwise compensated by very good 
scores in other phonemes. 

If N is chosen equal with one, the aforementioned rules are no longer needed, but always 
we propagate the path with the maximal current estimation of the confidence measure. The 
obtained results are very good, even if the defined optimum is guaranteed for this method 
only when N is bigger than the length of the sequence allowed by Lmax or of the tested 
sequence. 

The same approach is valid for the simple normalization, where the HMM for the searched 
word will be grouped into a single phoneme. 

3 .4. 2 The Method of Real Fitting 

We have also defined a new confidence measured that represents differently the exigencies 
of the recognition. Since the phonemes and the absent states can be modeled by the used 
HMMs, we find it interesting to request the fitting of each phoneme in the model with a 
section of the sequence. Therefore, we measure the confidence level of a subsequence as being 
equal with the maximum over all phonemes of the minus of the logarithm of the cumulated 
posterior of the phone, normalized with its length. 



max 



Yiphonem ^ \Og{pOSteriOTs) 



(10) 




phonem length 
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The rule that may be used in this framework for the reduction of the number of visited 
paths is: 

• Q2 is discarded in favor of another path Qi if the confidence measure of the Real 
Fitting for the previous phonemes is inferior (higher in value) for Q2 compared with 
Qi, and if pi < p2 and I2 < h- 

where pi, P2, h represent the minus of the logarithm of the cumulated posterior respec- 
tively the number of frames in the current phoneme for the path Qi respectively <52. 

Similarly to the previous method, the set of visited paths can be pruned by discarding 
those that: 

• P > LmaxPmax in any state 

• I > Pmax att the output from a phoneme 

where p and 1 are the values in the current phoneme for the minus of the logarithm of the 
cumulated posterior and for the length of the path that is discarded. We recall that the 
meaning of the constants are the maximal length I/max, respectively the accepted maxima 
of the minus of the logarithm of the cumulated and normalized posterior in phoneme, Pmax^ 

3.5 Conclusions 

We have thus proposed a new method for keyword spotting, based on recent advances in 
confidence measures, using local posterior probabilities, but without requiring the explicit 
use of filler models. 

A new algorithm, referred to as Iterating Viterbi Decoding (IVD), to solve the above 
optimization problem with a simple DP process (not requiring to store pointers and scores 
for all possible ending and start times), at the cost of a few iterations. Other three beam- 
search algorithms corresponding to three diflFerent confidence measures were also described. 

While the proposed approach allows for an easy generalization to more complex criteria, 
preliminary results obtained on the basis of 100 keywords (and without any specific tuning) 
appear to be particularly competitive to other alternative approaches. 

3*6 The object of the invention consists of: 

• Method of recognition of a subsequence using a direct maximization of confidence 
measures. 
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• The method of IVD for directly maximizing the confidence measures based on simple 
normalization. 

• The use of the confidence measure and method of recognition named 'Real Fitting', 
based on individual fitting for each phoneme. 

• Methods of recognition using simple and double normalization by: 

• combining these measures with additional confidence measures mentioned here, respec- 
tively the maximal length and real matching limitation. 

• The use of the aforementioned methods in keyword recognition. 

• The use of the aforementioned methods in subsequence recognition of organic matter. 

• The use of the aforementioned methods in recognition of objects in images. 

4 Best Mode for Carrying Out the Invention 

Execution: It is necessary to use a computer, but the method can also be implemented in 
hardware, 

1. A representation under the form of an HMM is obtained for the subsequences that are 
looked for (word, protein profile, section of an image of the object). 

2. A tool will be obtained (eventually trained Ex: for speech recognition) for the esti- 
mation of the posteriors. For example multi-Gaussians, neuronal networks, clusters, 
database with Generalized Profiles and mutation matrices (PAM, BLOSSUM, etc.), 

3. One of the proposed algorithms should be implemented. They yield close performance 
but the method of Real Fitting coupled with a well checked dictionary should perform 
best. 

For the first algorithm (IVD) 
(a) The classic algorithm of Viterbi is implemented with the modification that, for 



each pair P = {sample, state) one propagates the moments of transition between 
the state qg and the states of the HMM M for the path that arrives at P. These 
are inherited from the path that wins the entrance in the pair P, excepting for 
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the moment when their decision is taken, namely when they receive the index of 
the corresponding sample. 

(b) ^ - log P{M\XI) is computed by subtracting from the cumulated posterior 
that is returned by the Viterbi algorithm for the path Ql, the value (iV - (e - 6 + 
1)) * e corresponding to the contribution of the states qg and dividing the result 
through e-&4-l. e — 6+1 from the previous formula can be factorized outside 
the fraction. 

(c) The initialization of e is made with an expected mean value. One can use the w 
that is computed when the state Qg is associated with an emission posterior equal 
to the average of the best K emission probabilities of the current sample as done 
in the well-known "garbage on-line model" . In this case, K is trained using the 
corresponding technique. 

The next 'Beam search' algorithms, are implemented according to the description in 
the corresponding sections. For each pair P = {sample, state) one computes for each 
corresponding path the sum and length in the last phoneme, as well as the sum over 
the normalized cumulated posteriors of the previous phonemes (and their number). 
Also, the entrance and exit samples into the HMM M are computed and propagated 
like in the previous method, in order to ensure the localization of the subsequence. 

4. If one searched entity (keyword, sequence, object) can have several HMM models, all 
of them are taken into consideration as competitors. This is the case of the words 
with several pronunciations (or of the objects that have different structures in different 
states, for the recognition in images). 

After the computation of the confidence measure for each model of the subsequences, 
one eliminates those with a confidence measure in disagreement wdth a 'threshold' that 
is trained for the configuration and the goal of the given application. For example, for 
speech recognition with neuronal networks and minus of the logarithm of the posteriors, 
the 'threshold' is chosen in the wanted point of the ROC curve obtained in tests. 

5. The remained alternatives are extracted in the order of their confidence measure and 
with the ehmination of the conflicting alternatives until exhaustion. Each time when 
an alternative is eliminated, the searched entity with the corresponding HMM is re- 
estimated for the remaining sections in the sequence in which the search is performed, 
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If the new confidence measure passes the test of the 'threshold', then it will be inserted 

in the position corresponding to its score in the queue of alternatives. 

6. The successful alternatives can undergo tests of superior levels like for example a 
question of confirmation for speech recognition, opinion of one operator, etc. 

7. For objects recognition in images: 

Posteriors are obtained by computing a distance between the color of the model and 
that of element in the section of the image. If the context requires, the image will be 
preprocessed to ensure a certain normalization (Ex: changeable conditions of light will 
make necessary a transformation based on the histogram). 

The phonemes of the speech recognition correspond to parts of the object. The struc- 
ture {existence of transitions and their probabilities) can be modified, function of the 
characteristics detected along the current path. For example, after detecting regions 
of the object with certain lengths, one can estimate the expected length of the remain- 
ing regions. Thus, the number of the expected samples for the future states can be 
established and the HMM attached to the object will be configured accordingly. 
A direction is scanned for the detection of the best fitting and afterwards, other direc- 
tions will be scanned for discovering new fittings, as well as for testing the previous 
ones. The final test will be certified by classical methods such as cross-correlation or 
by the analysis of the contours in the hypothesized position. 



5 Industrial Applicability 

Here we present some examples for the application of the proposed method in the industry: 

• The recognition of keywords begins to be used in answering automates of banking 
system as well as telephone and automates for control, sales or information. The 
method offers a possibility to recognize keywords in spontaneous speech with multiple 
speakers. 

• The recognition of DNA sequences is important for the study of the human Genome. 
One of the biggest problem of the involved techniques consists in the high quantity of 
data that have to be processed. 
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• The recognition of objects in images is used, among others, in cartography and in the 
coordination of industrial robots. The method allows a quick estimation of the position 
of the objects in scenes and can be validated with extra tests, using classical methods 
of cross-correlation. 
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Independent Claim 1. 

Preamble: 

Recognizes subsequences, represented as Hidden Markov Models (HMM), that are searched 
for in a given sequence. 

We refer to the confidence measures, that are used for the reclassification of the winning 
hypotheses in Speech Recognition, These are some examples of such measures: 

simple normalization ~ accumulated posterior, normalized 

with the length of the subsequence 

double normalization = double normalization of the accumu- 
lated posterior over the number of 
phonemes and over the number of 
acoustic samples in each phoneme. 



characterized by: It allows the additional confidence measure, based on the extremes of 
the values of the logarithm of the accumulated posterior in each phoneme, normalized with 
its length. We call this measure 'real fitting'. 

Epkoneme " log{posteriors) 
max — ; ; 

phoneme eVzstted Phonemes pkoneme length 

characterized by: It searches the subsequences that offer the maximization of one men- 
tioned confidence measures, over all possible matchings. 

characterized by: It allows the revaluation of the alternatives that offer the highest among 
any mentioned confidence measure on the basis of another confidence measure. 

characterized by: It computes the alternative that maximizes the 'simple normalization' 
by using the method that we have called 'Iterative Viterbi Decoding' and that estimates 
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the emission probability of the filler states, in an iterative manner, as being equal to the 
confidence measure in the previous iteration. 

characterized by: It computes the alternative that maximizes the 'simple normalization', 
'double normalization' or 'real fitting' using an algorithm that considers the emission proba- 
bility of the filler state as zero. This method computes progressively, for each pair of sample 
and state of HMM, a set of possible alternatives paths to reach it. The computation of this 
set is based on the sets of paths that lead to the states that can be associated to the previous 
sample. 

This set can be reduced by using the given appropriate rules for the given confidence 
measure, ensuring the correctness of the inference. 

This set can be also reduced by using heuristics that are based on the aforementioned 
rules, for speeding up the computation despite the risk of reducing the theoretical quality of 
the recognition. 
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Dependent Claim 2. 

Preamble: 
It is based on the Claim 1. 

It estimates the existence of keywords and their position in utterances. 



characterized by: It uses the methods described in Claim 1, for recognition of subse- 
quences represented by Hidden Markov Models. 



18 



wo 00/51107 




PCT/IBOO/00189 



Dependent Claim 3. 

Preamble: 
It is based on the Claim 1. 

It estimates the existence of biomolecular subsequences and their position in the chains 
of DNA using models like generalized profiles. 



characterized by: The estimation of their existence and position is made according to the 
methods described in the Claim 1, for recognition of subsequences represented by Hidden 
Markov Models. 
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Dependent Claim 4. 

Preamble: 

It is based on the Claim 1. It carries out the estimation of the existence of objects and their 
position in images. 



characterized by: It uses the methods described in Claim 1, for the recognition of subse- 
quences represented by Hidden Markov Models (HMM). 

characterized by: Sections through views of virtual objects are modeled by sets of Hidden 
Markov Models. 

characterized by: It uses a probabilistic model based on a distance computed between 
colors. 

characterized by: The Hidden Markov Models that model the objects can be structured 
of distinct regions, that play in the frame of the method the role of the phonemes. 

characterized by: The models of the objects can be modified in a dynamic manner 
with respect to the transition properties (existence and probability) on the basis of the 
accumulated information during the fitting process. 
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